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Abstract 

We consider a stochastic control problem where the set of strict (classi- 
cal) controls is not necessarily convex and the the variable control has two 
components, the first being absolutely continuous and the second singular. 
The system is governed by a nonlinear stochastic differential equation, in 
which the absolutely continuous component of the control enters both the 
drift and the diffusion coefficients. By introducing a new approach, we 
establish necessary and sufficient optimality conditions for two models. 
The first concerns the relaxed-singular controls, who are a pair of pro- 
cesses whose first component is a measure-valued processes. The second 
is a particular case of the first and relates to strict-singular control prob- 
lems. These results are given in the form of global stochastic maximum 
principle by using only the first order expansion and the associated ad- 
joint equation. This improves and generalizes all the previous works on 
the maximum principle of controlled stochastic differential equations. 

Keywords. Stochastic differential equation, Strict-singular con- 
trol, Relaxed-singular control, Maximum principle. Adjoint process. Vari- 
ational inequality. 
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1 Introduction 



We study a stochastic control problem where the system is governed by a 
nonlinear stochastic differential equation (SDE for short) of the type 

rfx^"'"^ = b (t, x[''''^\vt^ dt + cr (t, i^t) dWt + Gtdr^t, 
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where b, a and G are given functions, x is the initial data and W = (Wt)j>Q is a 



standard Brownian motion, defined on a filtered probability space ( SI, {^t)t>o > ^ 



satisfying the usual conditions. 

The control variable, called strict-singular control, is a suitable process {v, rj) 
where v:[0,T]xVt — > J7i C M'', ?? : [0, T] x — > J/a ([0, oo))" arc B [0, T] 
.F-measurable, {Tt)- adapted, and rj is an increasing process (componentwise), 
continuous on the left with limits on the right with 770 = 0. We denote by U the 
class of all strict-singular controls. 

The criteria to be minimized, over the set lA, has the form 



where, g, h and k are given maps and x^'^' is the trajectory of the system 
controlled by [v,!]). 

A control {u, €U is called optimal if it satisfies 



This kind of stochastic control problems have been studied by many authors, 

both by the dynamic programming approach and by the Pontryagin stochastic 
maximum principle. The first approach was studied by Benes, Shepp and Wit- 
senhausen [6] , Chow, Menaldi and Robin [10] , Karatzas and Shreve [21] , Davis 
and Norman [11] , Haussmann and Suo [17, 18, 19] . Sec [17] for a complete list of 
references on the subject. It was shown in particular that the value function is 
solution of a variational inequality, and the optimal state is a reflected diffusion 
at the free boundary. Note that in [17] , the authors apply the compactification 
method to show existence of an optimal singular control. 

In this paper, we are concerned with the second approach, whose objective 
is to establish necessary (as well as sufficient) conditions for optimality of con- 
trols. The first version of the stochastic maximum principle that covers singular 
control problems was obtained by Cadenillas and Haussmann [8], in which they 
consider linear dynamics, convex cost criterion and convex state constraints. 
The method used in [8] is based on the known principle of convex analysis, 
related to the minimization of convex, continuous and Gateaux-differentiable 
functional defined on a convex closed set. Necessary conditions of optimality 
for non linear SDEs with convex control domain, where the coefficients depend 
explicitly on the absolutely part of the control, was derived by Bahlali and Chala 
[1] by applying a convex perturbation on the pair of controls. The result in then 
obtained in weak form. Bahlali and Mezerdi [2] generalize the work of [1] to the 
case of nonconvex control domain, and derive necessary optimality conditions 
by using a strong perturbation (spike variation) on the absolutely continuous 
component of the control and a convex perturbation on the singular one. The 
Peng stochastic maximum principle is then used and te result is given with 
two adjoint equations and a variational inequality of the second order. Version 
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of stochastic maximum principle for rclaxcd-singular controls was established 
by Bahlali, Djehiche and Mezerdi [4] in the case of uncontrolled diffusion, by 
using the previous works on strict-singular controls, Ekeland's variational prin- 
ciple and some stability properties of the trajectories and adjoint processes with 
respect to the control variable. 

In a recent work, Bahlali [5] generalizes and improves all the previous results 
on stochastic maximum principle for controlled SDEs, by introducing a new 
approach and establish necessary and sufficient optilmality conditions for both 
relaxed and strict controls, by using only the first order expansion and the 
associated adjoint equation. The main idea of [5], is to use the property of 
convexity of the set of relaxed controls and treat the problem with the convex 
perturbation on relaxed controls (instead of the spike variation on strict one). 

Our aim in this paper, is to follow the method used by [5] and derive neces- 
sary as well as sufficient conditions of optimality in the form of global stochastic 
maximum principle, for both relaxed-singular and strict-singular controls, with- 
out using the second order expansion. We introduce then a bigger new class TZ 
of processes by replacing the ?7i-valued process {vt) by a P (i7i)-valued process 
{qt), where P (Ui) is the space of probability measures on Ui equipped with the 
topology of stable convergence. This new class of processes is called rclaxcd- 
singular controls and have a richer structure, for which the control problem 
becomes solvable. 

In the relaxed-singular model, the system is governed by the SDE 



dxj^'"^ = / b 



b (t, x^"^ , a) qt {da) dt + a [t, xi"'"' , a) qt (da) dWt + Gtdvt, 



The functional cost to be minimized, over the class TZ of relaxed-singular 
controls, is defined by 



J{q,V)='^ 



g + £ J^h (t, «) Qt {da) dt + ktdrjt 



A relaxed-singular control {/u, ^) is called optimal if it solves 

J{fi,0 = , inf J{q,v)- 

The relaxed-singular control problem finds its interest in two essential points. 
The first is that an optimal solution exists. Haussmann and Suo [17] have 
proved that the relaxed-singular control problem admits an optimal solution 
under general conditions on the coefficients. Indeed, by using a compactification 
method and under some mild continuity hypotheses on the data, it is shown 
by purely probabilistic arguments that an optimal solution for the problem 
exists. Moreover, the value function is shown to be Borel measurable. The 
second interest is that it is a generalization of the strict-singular control problem. 
Indeed, if qt {da) = S^^ {da) is a Dirac measure concentrated at a single point vt 
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of I7i, then we get a strict-singular control problem as a particular case of the 
relaxed one. 

To achieve the objective of this paper and establish necessary and sufficient 
optimality conditions for these two models, wc proceed as follows. 

Firstly, we give the optimality conditions for relaxed controls. The main 
idea is to use the fact that the set of relaxed controls is convex. Then, we 
establish necessary optimality conditions by using the classical way of the convex 
perturbation method. More precisely, if we denote by (/x, ^) an optimal relaxed 
control and {q,r]) is an arbitrary element of TZ, then with a sufficiently small 
^ > and for each t G [0,T], we can define a perturbed control as follows 

=(Mt, 6) + ^ -(Mt, 6)]- 

We derive the variational equation from the state equation, and the varia- 
tional inequality from the inequality 

By using the fact that the drift, the diffusion and the running cost coefficients 

arc linear with respect to the relaxed control variable, necessary optimality 
conditions are obtained directly in the global form. The result is given by using 
only the first-order expansion and the associated adjoint equations 

To enclose this part of the paper, wc prove under minimal additional hy- 
potheses, that these necessary optimality conditions for relaxed-singular controls 
are also sufficient. 

The second main result in the paper characterizes the optimality for strict- 
singular control processes. It is directly derived from the above results by re- 
stricting from relaxed to strict-singular controls. The main idea is to replace 
the relaxed controls by a Dirac measures charging a strict controls. Thus, we 
reduce the set TZ of relaxed-singular controls and we minimize the cost over 
the subset 6 (Hi) x U2 = {(?,??) / q = Sy ; v G Ui}. Then, we derive 
necessary optimality conditions by using only the first order expansion and the 
associated adjoint equation. We don't need anymore the second order expan- 
sion. Moreover, we show that these necessary optimality conditions for strict- 
singular controls are also sufficient, without imposing neither the convexity of 
Ui nor that of the Hamiltonian H in v. 

The results of this paper are an important improvement of those of Bahlali 
and Mezerdi [2] and an extension of the works by Bahlali [5] to the class of 
singular controls. 

The paper is organized as follows. In Section 2, we formulate the strict- 
singular and relaxed-singular control problems and give the various assumptions 
used throughout the paper. Section 3 is devoted to study the relaxed-singular 
control problems and we establish necessary as well as sufficient conditions of 
optimality for relaxed-singular controls. In the last section, we derive directly 
from the results of Section 3, the optimality conditions for strict-singular con- 
trols. 
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Along with this paper, wc denote by C some positive constant and for sim- 
pHcity, we need the following matrix notations. We denote by Mn^di^) the 
space of n X d real matrix and A^^xn (^) linear space of vectors M = 
{Mi,...,Md) where M, e 7W„x« (K)- For any M,N e Miy,„{R), L,S G 
Mnxdi^), Q G Mnxni^), a, /3 G W and 7 G M'', we use the following no- 
tations 

n 

a(3 = ^^q;,/3, G M is the product scalar in R"; 

i=l 

d 

LS = ^^LiSi e K, where L, and Si are the i*'' columns of L and 5; 

i=l 
d 

ML = '^MiLi G M"; 

d 

Ma7= E (Mia)7i gM"; 

i=l 

MAT = Y,MiNi G A1„x„ W; 

d 

MQN = Y^MiQNi G Mnxn (K); 

d 

MQ7 = ^M,Q7, G A^nxn (R). 

We denote by L* the transpose of the matrix L and M* = {M^, M^). 



2 Formulation of the problem 



be a filtered probability space satisfying the usual 

conditions, on which a d-dimensional Brownian motion W = (Wt)j>Q is de- 
fined. We assume that (J^t) is the V— augmentation of the natural filtration of 
{Wt)t>o ■ 

Let T be a strictly positive real number and consider the following sets 
Ui is a non empty subset of MJ', 

[/2 = ([o,oo)r, 

Ui is the class of measurable, adapted processes v : [0,T] x Q 
that 



Ui such 



E 



sup \Vt\ 
te[o,T] 



< 00. 



U2 is the class of measurable, adapted processes rj : [0,T] x Q — > U2 such 
that 77 is nondecreasing (componentwise), left-continuous with right limits, r]o = 
0, and 

E |?7t|^ < 00. 
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2.1 The strict-singular control problem 



Definition 1 A strict-singular control is a pair of processes {v,r]) &Ui x W2. 
We denote by U =Ui XU2 the set of all strict- singular controls. 



For any {v, 77) G U, we consider the following SDE 



dx'"^'') = b {t, 4'''''\vt) dt + a (t, 4'''''\vt) dWt + Gtdrjt, 



iv,ri) 

Xq — X, 



where 



b : [0,T] X K" X C/i — > K", 
a : [0,T] xR" x Ih -^Mnxd(^), 
G:[0,T]^Mnxmm- 
The criteria to be minimized is defined from U into M by 



J{v,vi)=E 



g [x^r^''^^) + h{t,xi''''^\vt)dt + h 



dilt 



Where 



[0, T]xR'^ xUi — > M, 
[0,T]^([0,oo))''. 

A strict-singular control {v, t]) is called optimal if it satisfies 



J = inf J(t;,?7) . 
{v,Ti)eu 



We assume that 



b, a, g and h are continuously differentiable with respect to x. 
The derivatives b^, (^x,9x and hx, are continuous in (x, v) and 
uniformly bounded. 

b and a are bounded by C (1 + \x\ + \v\) . 
G and k are continuous and G is bounded. 



(1) 



(2) 



(3) 



(4) 



Under the above assumptions, for every {v^rj) £ equation (1) has an 
unique strong solution and the functional cost J is well defined from U into M. 
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2.2 The relaxed-singulcir model 



The strict-singular control problem {(1) , (2) , (3)} formulated in the last sub- 
section may fail to have an optimal solution. Let us begin by a deterministic 

examples which shows that even in simple cases, existence of a strict optimal 
control is not ensured (see Fleming [16] and Yong and Zhou [28] for other ex- 
amples). 

Example 1. The problem is to minimize, over the set U of measurable 
functions v : [0,T] — > {—1,1}, the following functional cost 

j{v)= r {x^.fdt, 

Jo 

where Xf denotes the solution of 

J dx^ = Vtdt, 
I = 0. 

We have 

inf J (v) = 0. 

veu 

Indeed, consider the following sequence of controls 

t;" = (-l)'^ if -T<t< , < < n - 1. 

Then clearly 



\J{v-)\ 





T 


< 






n 






< 









Which implies that 

inf J (v) = 0. 

veu 

There is however no control v such that J (v) = 0. If this would have been 
the case, then for every t, x^ = 0. This in turn would imply that Vt = 0, which 
is impossible. The problem is that the sequence (u") has no limit in the space of 
strict controls. This limit if it exists, will be the natural candidate for optimality. 
If we identify w" with the Dirac measure i5^ji (da) and set Qn {dt, dv) = Sv^^ {dv) dt, 
we get a measure on [0,1] x U. Then, the sequence {qn{dt,dv))^ converges 

weakly to -dt. [S-i + 6i] (da). 

Example 2. Consider the control problem where the system is governed by 
the SDK 

( dxt = vtdt + dWt, 
\ xo = 0. 
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The functional cost to be minimized is given by 



pi 

J{v)=E / x^t + {l-v^Y dt 



Jo 



U = [—1, 1] and X, v, W are one dimensional. The control v (open loop) is 
a measurable function from [0, T] into U. 

The separation principle applies to this example, the optimal control mini- 
mizes 



This problem has no optimal strict control. A relaxed solution is to let 



where 6a is an Dirac measure concentrated at a single point a. 

This suggests that the set of strict controls is too narrow and should be 
embedded into a wider class with a richer topological structure for which the 
control problem becomes solvable. The idea of relaxed-singular control is to 
replace the absolutely continuous part Vt of the strict-singular control by a 
P (C/i)-valued process {qt), where P (Ui) is the space of probability measures on 
Ui equipped with the topology of stable convergence of measures. 

Definition 2 A relaxed-singular control is a pair {q, rf) of processes such that 
i) q is a ¥ {Ui)-valued process progressively measurable with respect to {Tt) 

and such that for each t, l]o,t]-9 Ft-measurable. 
a) ?7 e 2^2 . 

We denote by TZ = TZi x U2 the set of relaxed-singular controls. 

For more details on relaxed controls, see [3] , [4] , [5] , [15] , [16] , [24] , [25] and 




where J* = E [xt] satisfies 





[26]. 



For any (q, rf) G 7?., we consider the following relaxed-singular SDE 




qt {da) dWt + Gtdr]t 



(5) 
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The expected cost to be minimized, in the relaxed-singular model, is defined 
from TZ into R by 



A relaxed-singular control (/U, ^) is called optimal if it solves 



(6) 



(7) 



Haussmann and Suo [17] have proved that the relaxed-singular control prob- 
lem admits an optimal solution under general conditions on the coefficients. 
Indeed, by using a compactification method and under some mild continuity 
hypotheses on the data, it is shown by purely probabilistic arguments that an 
optimal solution for the problem exists. Moreover, the value function is shown 
to be Borel measurable. See Haussmann and Suo [17], Section 3, page 925 to 
page 934 and essentially Theorem 3.8, page 933. 

Remark 3 // we put for any (g, ij) 

•J III 

h(t,xl''''>\q,)= f h{t,x'f'''\a)q,{da). 

J Ui 

Then, equation (5) becomes 

r dxj''") = b (t, x^") , qt) dt + a (t, x^") , qt) dWt + Gtdvt, 



X. 



With a functional cost given by 



J{q,V)='E 



Hence, by introducing relaxed-singular controls, we have replaced Ui by a 
larger space V{Ui). We have gained the advantage that V {Ui) is convex. Fur- 
thermore, the new coefficients of equation (5) and the running cost are linear 
with respect to the relaxed control variable. 

Remark 4 The coefficients b and a (defined in the above remark) check respec- 
tively the same assumptions as b and a. Then, under assumptions (4), for every 
(g, rf) G TZ, equation (5) has an unique strong solution. 

On the other hand. It is easy to see that h checks the same assumptions as 
h. Then, the functional cost J is well defined from TZ into M. 
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Remark 5 If qt = Sy^ is an atomic measure concentrated at a single point 
ft € P {Ui), then for each t € [0, T] we have 

and we get a strict- singular control problem. So the problem of strict- singular 
controls {(1) , (2) , (3)} is a particular case of relaxed- singular control problem 
{(5), (6), (7)}. 

3 Optimality conditions for relaxed-singular con- 
trols 



In this section, we study the problem {(5) , (6) , (7)} and we estabhsh neces- 
sary as well as sufficient conditions of optimality for relaxed-singular controls. 

3.1 Preliminciry results 

Since the set of relaxed-singular controls TZ is convex, a classical way of 
treating such a problem is to use the convex perturbation method. More pre- 
cisely, let (/X, ^) be an optimal relaxed-singular control and x\^'^^ the solution 
of (5) controlled by (/i, S). Then, for each t G [0,T], we can define a perturbed 
relaxed-singular control as follows 

(M?,^t) =(Mt,6) + ^[(9t,%)-(/^t,6)], 

where, ^ > is sufficiently small and (g, rf) is an arbitrary element of IZ. 

Denote by x\ ' ' the solution of (5) associated with (/x^,^*). 
From optimality of (/x, ^), the variational inequality will be derived from the 
fact that 

For this end, we need the following classical lemmas. 
Lemma 6 Under assumptions (4), we have 

2" 



lim 



sup E 
te[o,T] 



= 0. (8) 
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Proof. We have 



- XI 



^ b (^s,xl'^''^'^aj {da) - b (s,a;^«\a) /x^ (da) 
b (s, , a) III (da) - b (,s, x<^^'^ , a) /i, (da) 

a^lit (da)- j^a(s,xi^^^\a)iil {da) 
+ f\j a(s,xi'^'i\a]iit{da)- [ a (s, a) /x. (da) 

+ fGtd{^f-^t). 

Jo 

By using the definition of (/x^,^^) and taking expectation, we have 



Jo Uui 



ds 

ds 

dWs 

dWs 



E 
< CE 
+ C0^E 
+ CE 

+ ce^E 
+ ceE 



'Ui 



b\ s,Xs 



(/,C^) 



aj fis {da) — J b ^s, xl'^'^\a^ /ig {da) 



ds 



6|^s,a;s ' ',ajqs{da)-J b^s,Xs ' ' ,aj iJLs{da) 

(,'.,e) ^ ... 2 



ds 



>Ui 



ds 



lUi 



a \ s,x. 



a^ fis (da) ~ J a (^s, x^'''^^ , a^ fis (da) 
dJQs {da) — J a ys, Xs ' ,aj {da 



ds 



fGtd{r,t-^t) 
Jo 



Since b and a are uniformly Lipschitz with respect to x, and G is bounded, 
then 



ds + COE\riT -^t\^ +Ce'^. 



By using Gronwall's lemma and Buckholder-Davis-Gundy inequality, we ob- 
tain the desired result. ■ 



E 




2 

< CE/ 













11 



Lemma 7 Let z be the solution of the linear SDE (called variational equation) 

dzt = j hx (t, x['^'^\aj lit [da) ztdt 



+ 



+ 



j b (i, o) Mt {da) -J b{t, x\^'^\a) qt (da) 

ax [t, xf'^\a}j nt {da) ZtdWt 



zo = 
Then, we have 



a (t,x['^'^\a) lit {da) - / a (t,x['^'^\a) qt {da) 
Ui ^ ' Jui ^ ' 

+Gtd{7jt-it) 
0. 



dt 



dWt 



(9) 



limE 

0^0 



- Zt 



= 0. 



(10) 



Proof. It is easy to see that 



- XI 



e 



- Zt, 



does not depends on the singular part. Then the result follows immediately by 
the same method that in [5, Lemma 10, page 2086-2088]. ■ 

Lemma 8 Let {fJL,C) be an optimal relaxed- singular control minimizing the cost 
J over TZ and x\^'^^ the associated optimal trajectory. Then, for any {q, rf) € TZ, 
we have 



< 



g-x I ''^^ I ZT 



E / I hit, xl'"'^^ , a\ qt {da) - / hit, ^"'^^ , a) /i* {da) 

Jo lJ Ui J Ui 

e( ktd{rjt-^t)- 
Jo 



j hx(t,x[^'^\c^nt{da)ztdt (11) 



+ 



+ 



dt 
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Proof. Since minimizes the cost J over TZ, then 

o< j(m,0 

< E 

l-T 



+ Ej j h(t, x['''^^ , aj {da) dt-¥.j j h(t, x['"'^'^ , aj nt {da) dt 

+ Kfktd{£,^-^t). 

Ja 

By using the definition of (/i^,^^), we get 

a) — J h ^t, x['^'^-' , aj lit {da) dt 



< E 



g[x'^ '^^ ] - gi 



+ E 



/ I h (t,x^'' \ a] iJ.t {do 
Jo Uui \ 



+ 0E 



hlt,Xt ' ,a\qt{da)— / h[t,Xf ' ,a] fii:{da) 
Ui \ J Jui 



dt 



+ eE[ M(r?t-6)- 
Jo 

Hence, 



< EjII 5x (x!^'^'^ + X0 + zt)) zrdX (12) 

+ E / / [ h^(t, x[^'^^ + X0 {Xf + zt) ,a) nt {da) ZtdXdt 
Jo JuiJo ^ ' 

+ E / \ h{t, x\^'^'' , a) qt {da) - j h (t, 4"'*^ , a) Mt {da) dt 

+e[ ktd{Tit-it) + pl 

Jo 



where 



- Zt, 



and Pt is given by 

p^t = eJ^ (4^'*' + {X^ + zt)) X^dX 

+ ^J^ J J^l^x (t, x[^'^^ + Xe {Xf + Zt) , aj lit {da) XfdXdt. 
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By (10), we have 



limE =0. 



Since and are continuous and bounded, then by using the Cauchy- 
Schwartz inequahty we get 

limp? = 0, 

and by letting 6* go to in (12), the proof is completed. ■ 

3.2 Veiriational inequality and adjoint equation 

In this subsection, we introduce the adjoint process. With this process, we 
derive the variational inequality from (11). The linear terms in (11) may be 
treated in the following way. Let $ be the fundamental solution of the linear 
SDE 



^tdWt, 



This equation is linear with bounded coefficients. Hence, it admits an unique 
strong solution which is invcrtiblc, and its inverse 'ff is the unique solution of 



d^t 



a, (t, a;^"'*) , a) fit {da) % [ a* (t, 4"'^^ , a) in {da) 
(t,x[''-^\a^ Ht (da) ^tdt 
-j^ (t, a) fit {da) ^tdWt, 



dt 



*o Id- 
Moreover, $ and satisfy 



E 


sup |$t|^ 


+ E 


sup |*t|^ 




te[o,T] 




te[o,T] 



< 00. 



We introduce the following processes 
at = "btZt, 

X = $^5^(4'''*^) + j ^t^- 4'''^\<^) ida) dt, 
Ft = E [X / Tt] - J* [s, a) /x« {da) ds. 



/O JUi 

We remark from (14) , (15) and (16) that 



(13) 

(14) 
(15) 

(16) 
(17) 
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Since Qx and arc bounded, then by (13), X is square integrablc. Hence, 
the process (E [X / J-t\)t>o is a square integrable martingale with respect to 
the natural filtration of the Brownian motion W. Then, by Ito's representation 
theorem we have 

Yt=¥.[X]+ Q.dWs- J (s,4^'«U)/x,(da)ds, 

where, Q is an adapted process such that E / \Qs\ ds < oo. 

Jo 

By applying Ito's formula to at then with atYt and using (17), the variational 
inequality (11) becomes 



< E 



dt 
(18) 



+ E/ {kt + G;pt)d{T^t-^t): 



where, the Hamiltonian H is defined from [0, T] x R" x P (t/i) x K" x Mnxd {^) 
into IR. by 

H{t,x,q,p,P) = / h{t,x,a) q{da)+ b{t,x,a) q{da)p+ a {t,x,a)q{da) P, 
Jui Jui Jui 

(^pit^'i) ^ p(t^'i)'j is a pair of adapted processes given by 



Pi 



_ ,T/* 



= , p^^''^^ e £2 ([0, T] ; R") 



(19) 



P,^^'^^ = ^tQt - f al {t,x\'''^\a) ida)p[^'^\ P^^'^^ e ([0,T] ;M"X'^) , 

(20) 



and the process Q satisfies 
i-t 



f 

Jo 



QsdWs = E 



-E 



^Mx^t'^^) + ^ (t, :r^^'«\ a) /x* (da) dt / Tt 

^*Tg.{xT'^^) + ^*tj^ {t, a) (da) dt 



The process ^) is called the adjoint process and from (15) , (16) and (19), 
it is given explicitly by 



Pi 



E 



*:$5.ff,(4'''«^) + (s,4^'^\a) /X, {da) ds I 



15 



By applying Ito's formula to the adjoint processes in (19), we obtain 

the adjoint equation, which is a linear backward SDE, given by 

3.3 Necessary optimality conditions for releixed-singular 
controls 



Starting from the variational inequality (18), we can now state the necessary 
optimality conditions, for the relaxed-singular control problem {(5) , (6) , (7)}, 
in integral form. 

Theorem 9 (Necessary optimality conditions for relaxed-singular controls in 

integral form) . Let (/x,^) be an optimal relaxed-singular control minimizing the 
cost J over TZ and x^^'^^ denotes the corresponding optimal trajectory. Then, 
there exists an unique pair of adapted processes 

solution of the backward SDE (21) such that, for every {q,ri) £ TZ 
0<e£ [H(t,x(^'«\g„p^«,P^«)) -H(t,x[^''\„t,p't'''\p}'''^ 



dt 
(22) 



+ 



Proof. The result follows immediately from (18). ■ 

We are ready now state necessary optimality conditions for the relaxed- 
singular control problem {(5) , (6) , (7)}, in global form. 

Theorem 10 (Necessary optimality conditions for relaxed-singular controls in 
global form). Let (/U, ^) be an optimal relaxed-singular control minimizing the 
cost J over TZ and x^'^'^^ denotes the corresponding optimal trajectory. Then, 
there exists an unique pair of adapted processes 

(^p{^^,0 ^ p{^^,0^ e£^([0,T];M") x £2 ([o,T] iM"^"^) , 

solution of the backward SDE (21) such that 

w(t,a;^«,M*,p^«\p('''«) = inf H (t,xi^'^\qup'i^'^\H^'^^) , a.e, a.s, 

(23) 

P {\/t e [0, T],\/i- (k, {t) + G* it) > O} = 1, (24) 
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Proof. Let be an optimal solution of problem {(5) , (6) , (7)}. The nec- 

essary optimality conditions in integral form (22) is valid for every {q, rj) € TZ. 
If we put in (22) r] — S^, then (23) becomes immediately. On the other hand, if 
we choose in (22) q = ji, then we can show (24) and (25), by the same method 
that in [8, Theorem 4.2] or [4, Theorem 3.7]. ■ 

3.4 Sufficient optimaUty conditions for releixed-singular 
controls 



Theorem 11 (Sufficient optimality conditions for relaxed- singular controls). 
Assume that the functions g and x i — > Ti. {t, x, q,p, P) are convex. Then, (ii, ^) 
is an optimal solution of problem {(5) , (6) , (7)}, if it satisfies (23) , (24) and 
(25). 

Proof. We know that the set of relaxed- singular controls IZ is convex and the 
Hamiltonian Ti. is linear in q. 

Let (/Lt, ^) be an arbitrary element of TZ (candidate to be optimal). For any 
(g, ri) G TZ, we have 



+ E 



h (t, x'l^'^'^ , a) nt (da) - ( h(t, x^"'"'^ , a) qt (da) 

+e[ hd{it-7^t). 

Jo 

Since g is convex, we get 

, (4-)) - g (4^^)) > g. (4'"' - 4"^0 • 



dt 



Thus, 

, (x(.-«) - , (4-)) < g. (4^'«) (4'"«' - 4"'0 • 

Hence, 

J (m, 0-J {q, V)<E [g, (xi,^'^^) (4^'«) - xf?'") 
T r 

Jui 



h (t, x'l'"'^'^ , a) nt {da) -I h(t, ^"^'"^ , a) qt {da) 

e/ ktd{^t-m)- 

Jo 



dt 
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We remark that pi^'^^ = g. 



X 1 Jjrp I , 



then we have 



+ E 



T 







Ui 



h (t, 4'^'^^ , a) lit {da) ~ h(t, 4"'") , a) qt (da) 



(It 



+ e[ ktd{^t-Vt)- 
Jo 



Applying Ito's formula to p[^'^^ (^['^'^^ — x^"^'^^^ and taking expectation, we 
obtain 



< E 



+ e£ (kt + G;pi^'^^)d{^t-vt). 



<dt:Pt ) f 



(26) 



dt 



Since Ti, is convex in x and linear in /i, then by using the Clarke generalized 
gradient oiH evaluated at {xt,iJ-t) and (23), it follows that 

H {t,x['''^\qt,p[^'^\P,^^'^^) -n(t,x\'''^\ntJr'^\P^/'^^) 
Or equivalcntly 

> n (t,x<f'^\ntJr'^\p^,^'^^) - n (t,x^^\ft,p^«,p^«) 

By the above inequality and (26), we have 

J (m, 0-J {q, v)<^ j'^ {kt + Gip[^'^^) d (6 - m) . 

By (24) and (25), we show that 

E^"^ {kt + Glp^'^'^^) d ivt - 6) > 0. 

Then, we get 



The theorem is proved. 
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4 Optimality conditions for strict-singular con- 
trols 



In this section, we study the strict-singular control problem {(1) , (2) , (3)} 
and from the results of section 3, we derive the optimality conditions for strict- 
singular controls. 

Throughout this section and in addition to the assumptions (4), we suppose 
that 

J/i is compact, (27) 
b, <j and h are bounded. (28) 

Consider the following subset of TZ 

SiUi) xU2 = {{q,r]) en I q = 5, ; v €Ui} . 

Denote by 5 {Ui) x U2 the action set of all relaxed-singular controls in 5 {U\) x 

If ((7, r]) G 6 iUi) X U2, then (g, rf) = ((5„, r]) with v &U\. In this case we have 
for each t, {qt,Vt) = (K^Vt) G ^ {Ui) x U2. 

We equipped P{Ui) with the topology of stable convergence. Since Ui is 
compact, then with this topology P(J7i) is a compact metrizable space. The 
stable convergence is required for bounded measurable functions / (i, a) such 
that for each fixed t G [0,T], f {t, .) is continuous (Instead of functions bounded 
and continuous with respect to the pair (f, a) for the weak topology). The 
space P (Ui) is equipped with its Borel c- field, which is the smallest tr-field such 

that the mapping q 1 — > J f (s, a) q {ds, da) are measurable for any bounded 

measurable function /, continuous with respect to a. For more details, see Jacod 
and Memin [20] and El Karoui et al [15]. 

This allows us to summarize some of lemmas that we will be used in the 
sequel. 



Lemma 12 (Chattering Lemma). Let q be a predictable process with values in 
the space of probability measures on Ui. Then there exists a sequence of pre- 
dictable processes {u^^)„ with values in Ui such that 

dtq^ (da) = dtSu" (da) — > dtqt (da) stably, V — a.s. (29) 

where is the Dirac measure concentrated at a single point of Ui . 
Proof. See El Karoui et al [15]. ■ 
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Lemma 13 Let q S TZi and (m")„ C lAisuch that (29) holds. Then for any 
hounded measurable function f : [0,T] x Ui ^ M., such that for each fixed 
t e [0, T], f {t, .) is continuous, we have 



/ / {t, a) Su^ (da) — > / f{t, a) qt (da) ; 
Jui Jui 



dt 



(30) 



Proof. By (29), and the definition of the stable convergence (see Jacod and 
Memin [20, definition 1.1, page 529], we have 



JUi 



f (t, a) 6u^ (da) dt 



JUi 



f {t, a) qt (da) dt. 



Put 



g{s,a) = l[o,f] (s)/(s,a). 

It's clear that g is bounded, measurable and continuous with respect to 
a. Then, by (29) we get 

/ / g{s,a)5u^ (da)ds — > / / g {s , a) q^ {da) ds . 
Jo Jui " Jo Jui 

By replacing g (s, a) by its value, we have 



nf {s, a) (5„y (da) ds 
- Ji ' 



f {s,a) qs (da) ds. 



JUi 



The set {(s, t) ; < s <t <T} generate B[o^t]- Then for every B s B[o,t], 
we have 



/ (s, a) 6u^ (da) ds 



iBJUi 

This implies that 



/ (s, a) qs {da) ds. 



BJUi 



/ / (s, a) 5un (da) — > / / (s, a) qs (da) , dt - a.e 
Jui Jui 



The lemma is proved. 



The next lemma gives the stability of the controlled SDE with respect to 

the control variable. 

Lemma 14 Let {q, rj) € TZ be a relaxed- singular control and x^'^''^^ the corre- 
sponding trajectory. Then there exists a sequence {u^,r])^ C U such that 



lim E 

n— »oo 



sup 

te[o,T] 



(«",»)) _ (q,ri) 



limJiu^,7^) = Jiq,r,). 
where x^^""'^^ denotes the solution of equation (1) associated with (^"',77) , 



(31) 
(32) 
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Proof, i) Proof of (31). We have 



E 



< c 



+ C / E 
Jo 
/•* 

+ C 



b' 

bis. 



x'^'^'^u^) - f bUxi'^'^\a\q,ida) 

J Ui 

^ E I a (s, xi^" ,u^)-a(^s, xi^'") , tx^) | ' ds 



ds 



C E 



Since b and cr are uniformly Lipschitz with respect to x, then 

2 



E 



ds 



(33) 



Jo 



< C / E 
/o 

c/ E 



+ C 



ds 



Ui 



U xl^'") , a) (da) - / b(s,xi'^^^\a] {da) 
a (s, xi^'"' , a\ Sun {da) - ( a [s, xi'-") , a) g« (da) 



ds 



ds 



Since b and a are bounded, measurable and continuous with respect to a, 
then by (30) and the dominated convergence theorem, the second and third 
terms in the right hand side of the above incquahty tend to zero as n tends to 
infinity. We conclude then by using Gronwall's lemma and Bukholder-Davis- 
Gundy inequahty. 

ii) Proof of (32). By using the Cauchy- Schwartz inequality and the fact that 
g and h are uniformly Lipschitz with respect to a;, we get 



< C E 



+ E 



1/2 



c 



1/2 



E 



ds 



Ui 



h (s, xi"^"^ , a) {da) dt - j h (t, x^"'"^ , a) qt {da) 



2 \ 1/2 
dt 



By (31), the first and second terms in the right hand side converge to zero. 
Moreover, since h is bounded, measurable and continuous in a, then by (30) 
and the dominated convergence theorem, the third term in the right hand side 
tends to zero as n tends to infinity. This prove (32). ■ 
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Lemma 15 As a consequence of (32), the strict- singular and the relaxed- singular 
control problems have the same value functions. Thai is 

M J{v,v)=ini J{q,n). (34) 

Proof. Let (w,^) G U and (/x,^) € 72. be respectively a strict-singular and 
relaxed-singular controls such that 

J{u,^)= inf J{v,v), (35) 

{v,r])eU 

J(m,C)= inf^J((?,r/). (36) 

By (36), we have 

Since 5{Ui) XU2 C TZ, then 

J {ti,0 < J {<1,V) ,y {q,v) & S {U,) XU2. 
Since {q,r]) e S {U\) x U2, then {q,ri) = {6y,r]), where v gUi. Then we get 

Hence 

The control (u,$) becomes an element oiU, then we get 

J{l^,0<J{u,0- (37) 

On the other hand, by (35) we have 

J{u,^)<J{v,v),y{v,v)&U. (38) 

The process n becomes an element of TZi, then by the Chattering lemma 
(Lemma 12), there exists a sequence (w")^ C Ui such that 

dt^" (da) = dtSu^ {da) — > dt^t (da) stably, P — a.s. 

Relation (38) holds for every {v, rj) e U. This is true for (u", ^) eU,\fne N. 
We get then 

By using (32) and letting n go to infinity in the above inequality, we get 

J{u,0<J{ti,0- (39) 
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Finally, by (37) and (39), we have 

J(n,0 = J(m,0- 

The lemma is proved. ■ 

To establish necessary optimality conditions for strict-singular controls, we 
need the following lemma 

Lemma 16 The strict-singular control (u,^) minimizes J overU if and only if 
the relaxed-singular control (/U, ^) = ((5„,^) minimizes J over TZ. 

Proof. Suppose that (w,^) minimizes the cost J over U, then 

J (u,0 = , inf / {v,v)- 

(v,r])eU 



By using (34), we get 



J{u,0= inf J{q,v) 



Since (/x,^) = {Su,£,), then 



This implies that 



(40) 



Conversely, if (/U, ^) = ((5u,0 minimize J over TZ, then 

(q,rj)£n 

From (34), we get 

Jil^,0 = , inf Jiv,rj). 

Since (/U, ^) = (5^,^), then relations (40) hold, and we obtain 

J (w,0 = inf J (t;,??). 
(v,?7)ew 

The proof is completed. ■ 

The following lemma, who will be used to establish sufScient optimality 
conditions for strict-singular controls, shows that we get the results of the above 
lemma if we replace 1Z hy 6 ilAi) x U2- 

Lemma 17 The strict- singular control (w, ^) minimizes J overU if and only if 
the relaxed control (/U,0 = ("^uiO fninimizes J over S (Ui) x W2. 
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Proof. Let (/i,^) = (Su^S.) bo an optimal relaxed-singular control minimizing 
the cost J over 6 {U\) XU2, wc have then 

J{f^,0<J{Q,v), V{q,v)&S{U^)xU2. (41) 

Since q G 5 (Wi), then there exists v gUi such that q = Sy. Hence, {Syjf]) = 
{q,ri), and since (/u, ^) = {6u,^), it is easy to see that 

' JM = j{u,l), 
. J {q,v) = J {v,v) ■ 

By (41) and (42), we get then 

J{u,0<J{v,v), V(«,77)GW. 

Conversely, let (it, ^) be a strict-singular control minimizing the cost J over 
U. Then 

J{u,^)<J{v,ri), y{v,Tj)GU. 

Since the controls u,v &Ui, then there exist ii,q & 5 (JAi) such that jJ. = 6u 
and q = dy. Then 

(M,e) = ('5«,e), 

{q,v) = {Sv,v)- 

This implies that relations (42) hold. Consequently, we get 

J{I^,0<J{<1,V), y{q,v)&S{Ui)xU2. 
The proof is completed. ■ 

4.1 Necessciry optimality conditions for strict-singulcir con- 
trols 



Define the Hamiltonian in the strict case from [0,T] x M" x f/i x M" x 
Mnxd (K) into M by 

H {t,x,v,p,P) = h{t,x,v) + b{t,x,v)p + a {t,x,v) P. 

Theorem 18 (Necessary optimality conditions for strict-singular controls in 
global form) . Suppose that (w,^) is an optimal strict- singular control minimizing 
the cost J overU andx'^"'^^ denotes the solution o/(l) controlled by (u,^). Then, 
there exists an unique pair of adapted processes 

(p("'«\p("'«)) e £2([o,T];IR") X £2 ([Q, T] ; R"^'') , 
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solution of the backward SDE 

1 = -H, dt + P^'^^dW„ ^^^^ 

such that 

H(t,x[^'^\m,p[^'^\P,^^'^^)= inf H(t,x[^'^\vt,p[^'^\P^^'^A, a.e, a.s. 

(44) 

V {yt e [0, T] , Vi ; (A:, {t) + G* {t) > o} = 1, (45) 

Proof. The optimal strict-singular control {u, ^) is an element of U, then there 
exists (/U, ^) € S {Ui) X U2 such that 

Since (u,^) minimizes the cost J over then by lemma 16, mini- 
mizes over 7^. Hence, by the necessary optimality conditions for relaxed- 
singular controls (Theorem 10), there exists an unique pair of adapted processes 
(^p(M.i) ^ p(M.i)^ ^ solution of (21), such that relations (23) , (24) and (25) hold. 

Since 5(f/i) C P(f/i), then by (23), we get 

n (i,a.^«,/z„p^«\P^«)) < n {t,x[^'^\qt,p[^'^\P,^^'^^) , Vqt e 5([/i), a.e, a.s. 

(47) 

Since q € S {U\), then there exists v &U\ such that q = 5y. 

We note that v is an arbitrary element of U\ since q is arbitrary. 

Now, since (/U,0 = (i^uiO ^^^^ {q,^) = {Sy,^), we can easily see that 



H P/-«) = H , 



(48) 



where (p(«'«), p(".«)) is the unique solution of (43). 

By using (47) and (48), we deduce (44). Relations (45) and (46) follows 
immediately from (24) , (25) and (48) . The proof is completed. ■ 

Remark 19 Bahlali and Mezerdi [2], established necessary optimality condi- 
tions for strict- singular controls of the second-order with two adjoint processes. 
The result of the above theorem improves that of [2] , in the sense where, we con- 
sider the same strict-singular control problem, with nonconvex control domain 
and a general state equation in which the control variable enters both the drift 
and the diffusion coefficients, and we establish necessary optimality conditions 
of the first-order with only one adjoint process. 
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4.2 Sufficient optimality conditions for strict-singulcir con- 
trols 



Theorem 20 (Sufficient optimality conditions for strict-singular controls). As- 
sume that the functions g and x i — > H {t, x, q,p, P) are convex. Then, {u, ^) is 
an optimal solution of problem {(1) , (2) , (3)} if it satisfies (44) , (45) and (46) . 

Proof. Let (u,^) € W be a strict-singular control (candidate to be optimal) and 

(v, rj) an arbitrary clement of U. 

The controls u, v are elements of Ui, then there exist iJ,,q G S (Ui) such that 
fjb = 5u and q = Sv Hence, 

This implies that relations (48) hold. Then, by (44) , (45) and (46), we 
deduce respectively the relaxed relations 

n[t,Xf ,fM,Pt ,Pt )— ,'i-[t,Xf ,qt,Pt ,Pt )> fl-e, os, 

(49) 

V {Vt e [0, T] , Vi ; (fc, it) + G* (t) .p^''-^^) > O} = 1, (50) 

^{E1{M*HC,(*).-->o}'^^*=o}=1- (51) 

We remark that the infimum in (49) is taken over S (Ui) . 

Now, since H is convex in x, it is easy to sec that Ti. is convex in x, and since 
g is convex, then by using (49) , (50) and (51), and by the same proof that in 
theorem 11, we show that {fi,^) minimizes the cost J over d (Ui) x U2- Then, 
by Lemma 17, we deduce that (u, ^) minimizes the cost J over U. The theorem 
is proved. ■ 

Remark 21 The sufficient optimality conditions for strict-singular controls are 
proved without assuming neither the convexity of U\ nor that of the Hamiltonian 
H in V. 
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